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REMARKS 

This Response is submitted in reply to the Final Office Action dated March 4, 2005 and 
the Advisory Action dated April 27, 2005. Claims 1-13, 15-28 and 30-35 are pending in the 
patent appHcation. Claims 14 and 29 were withdrawn. Claims 1, 6, 9, 12, 15, 17, 22, 26, 27, 28, 
30 and 31 have been amended for clarification purposes and not for any reasons of patentability. 
No new matter has been added by any of the amendments made herein. A Request for 
Continued Examination (RCE) and a Information Disclosure Statement have been submitted 
with this Response. 

Claims 1, 4, 5-7, 9, 10, 12, 15, 16, 22, 24, 25, 26-28 and 30 were rejected under 35 
U.S.C. § 102(e). Claims 2, 3, 8, 1 1, 17-21, 23 and 31-35 were rejected under 25 U.S.C. § 103(a). 
Applicant respectively submits, for the reasons set forth below, that the rejections have been 
overcome or are improper. Accordingly, Applicant respectfully requests reconsideration of the 
patentability of Claims 1-13, 15-28 and 30-35. 

Claims 1, 4, 5-7, 9, 10, 12, 15, 16, 22, 24, 25, 26-28 and 30 were rejected under 
35 U.S.C. § 102(e) as being anticipated by U.S. patent No. 5,917,490 to Kuzunuki et al. 
Q'Kuzunuki''), Applicant respectively disagrees with the Patent Office and submits that Kuzunuki 
does not disclose all of the elements of Clams 1-13, 15-28 and 30-35. 

Kuzunuki is directed to an interactive information processing system and method which 
enables a user to physically manipulate electronic information on a display screen such as a 
computer screen. (See the Abstract). Specifically, Kuzunuki includes a desk cabinet 100 having 
a horizontally installed plane display 101 and a vertically installed front display 102 that are 
combined together. Additionally, the system includes an overhead camera 300 and projectors 5 
and 106 which transforms physical or actual objects into images (Col. 7, lines 30-35; Figs. 1 and 
2). As shown in Figs. 6A to 6C, an image object 104 (image of a document) is manipulated by 
the hands 200-1 and 200-2 of a user on a display. Kuzunuki is therefore directed to an 
information processing system which utilizes image recognition to enable users to scan and 
display images of physical objects on a display screen and manipulate the images of the objects 
on that display screen. 

Kuzunuki does not disclose, teach or suggest one or more physical objects mounted on an 
operation surface where the physical objects include a visually identifiable visual marker 
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included on the surface of each of the physical objects to identify the physical objects and the 
objects' location in the physical environment as in the claimed invention. 

On the contrary, Kuzunuki uses image recognition to define the attributes of the physical 
object. Specifically, Kuzunuki requires that each physical object be scanned as an image where 
the image is manipulated by the user. (Col. 7, Hne 58 to Col. 8, line 15). A table or menu 101-2 
is generated which indicates the correspondence between the "characteristic amount data and 
operations." (Col. 7, lines 58-65). Accordingly, the system in Kuzunuki is limited to the 
displays 101 and 102 and cannot be expanded to the physical environment such as the walls of a 
room, a facsimile machine and or a printer which are not on the displays 101 and 102 as with the 
claimed invention. 

Accuracy is also an issue when scanning images in this manner. As stated in Kuzunuki, 
"[t]o enable direct touch of image objects and use of actual objects as man-machine interface 
parts, the attributes of the actual objects must be defined so that the processor can understand 
what they mean." (Col. 7, lines 57-63). Physical objects must therefore be scanned accurately to 
provide enough detail for the processor to identify each object. Scanning the objects therefore 
requires a significant amount of time and accuracy, and requires that the physical object be 
moved in front of the camera to be scanned or that the camera be moved to scan the object.. In 
either case, such actions require substantial time and effort, which is not required by the claimed 
invention. 

Moreover, the process of defining the attributes of the objects must be done in advance 
before the objects can be employed by the system in Kuzunuki. (Col. 7, lines 65-67). The 
claimed invention on the other hand, employs visual markers which are manually placed on the 
physical objects to identify the object and the position of the object. No pre-scanning or pre- 
defining the attributes of the physical objects is required by the claimed invention. 

Furthermore, in the Advisory Action, the Patent Office states that: 

clearly . . . Kuzunuki shows the barcode or identification number is 
assigned/located on objects as the visual identifiable visual marker included on 
the surface of each of the physical objects (e.g., col. 21 lines 20-26). (See the 
Advisory Action, page 2, first paragraph). 
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Applicants respectfully disagree and submit that the barcode or identification number 
described in Kuzunuki is different from the visual marker of the claimed invention. As described 
in Kuzunuki: 

As still another contemplated method, a bar code is assigned to an object and the 
object may be discriminated by using a bar code reader. A device for generating a 
[sic] identification number using infrared light or minute radio waves may be 
attached to an object and a device for receiving the identification number may be 
installed in the object discrimination unit 2006 according to certain contemplated 
embodiments. (Col. 21, lines 19-26). 

hi Kuzunuki, the bar code or identification number merely identifies the object. The bar 
code does not provide location information of the object by scaiming or reading the bar code as 
in the claimed invention. For example, bar codes used in grocery stores identify a product and 
the price of the product but does not identify the location of the product. For at least these 
reasons, Kuzunuki does not disclose, teach or suggest attaching a visual marker to physical 
objects to provide "the identification information mA the position information of each of the 
physical objects by identifying the visual marker on the surface of each of said physical objects" 
as in the claimed invention. 

For at least these reasons, Claim 1 and Claims 3-5 which depend from Claim 1, are each 
patentability distinguished over Kuzunuki and are in condition for allowance. 

Lidependent claims 6, 9, 12, 15, 22, 26-28 and 30 each include certain similar elements to 
Claim L Accordingly for the reasons provided above for Claim 1, Claims 6, 9, 12, 15, 22, 26-28 
and 30, and Claims 7-8, 10-12, 13 and 23-25 which depend from these claims, respectively, are 
each patentability distinguished over Kuzunuki and in condition for allowance. 

Claims 2, 3, 8, 11, 17-21, 23 and 31-35 were rejected under 35 U.S.C. § 103(a) as being 
unpatentable over Kuzunuki in view of "the digital desk calculator," proceedings of ACM 
symposium on user interface software and technology (UIST) 11-13 November, 1991 written by 
Pierre Wellner CWellner''), Applicant respectively disagrees with and traverses this rejection for 
the following reasons. 

As described in the previous response. Claims 2 and 3 depend from independent Claim 1 . 
Claim 8 depends from independent Claim 6. Claim 11 depends from independent Claim 9. 
Claim 23 depends from independent Claim 22. Accordingly, Claims 2, 3, 8, 11 and 23 are 
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allowable for at least the reasons set forth above with respect to independent Claims 1, 6, 9 and 
22, respectively, and for the further reasons that the combination of Kuzunuki and Wellner fails 
to disclose, teach or suggest the subject matter of Claims 2, 3, 8, 1 1 and 23 in combination with 
the subject matter of independent Claims 1, 6, 9, and 22. For these reasons, Claims 2, 3, 8, 11 
and 23 are patentably distinguished over the combination of Kuzunuki and Wellner and are in 
condition for allowance. 

Regarding independent Claims 17 and 31, the Office Action states that Kuzunuki teaches 
all of the elements of these claims but does not teach that "the physical object is a portable 
computer capable of being moved in said information space in exchanging digital objects with 
other computers." (See, the Office Action, pages 8 and 9). The Patent Office therefore attempts 
to remedy the deficiencies of Kuzunuki using Wellner, Applicant respectfully submits that the 
combination of Kuzunuki and Wellner does not disclose, teach or suggest the elements of Claims 
17 and 31 for the following reasons. 

Kuzunuki teaches the physical manipulation of an image of a physical object on a display 
such as a computer screen as described above. For example, the image of the user hands can 
manipulate an image of a file to move the file to different positions on the display screen. As 
described above, Kuzunuki does not disclose, teach or suggest utilizing a visual marker which 
includes identification and location information of physical objects, a processing operation that 
recognizes a digital object dropped onto a site on a surface of physical object and a processing 
operation of forming link information for linking the digital object to the drop site on the surface 
of the physical object. 

Similarly, Wellner teaches a system that allows a user to interact with paper and 
electronic objects by physically touching them to manipulate them. However, Wellner also does 
not disclose, teach or suggest dropping or transferring a digital object onto a site or surface of a 
physical object where each physical object includes a visual marker on a surface of the physical 
objects and where the visual marker includes identification and location information of the 
physical objects . Accordingly, the combination of Kuzunuki and Wellner does not disclose, 
teach or suggest the elements of Claims 17 and 21. 

For at least these reasons, Claim 17 and Claims 18 to 21 which depend from Claim 17, 
and Claim 31 and Claims 32-35 which depend fi"om Claim 31, are each patentably distinguished 
over the combination of Kuzunuki and Wellner and are in condition for allowance. 
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In light of the above, Applicant respectively submits that Claims 1-13, 15-28 and 30-35 
are patentable over the art of record because neither Kuzunuki or Wellner when taken alone or in 
combination, disclose, teach or suggest all the elements of these claims. Accordingly, Applicant 
respectively requests that Claims 1-13, 15-28 and 30-35 be deemed allowable at this time and 
that a timely notice of allowance be issued in this case. 

A check in the amount of $790.00 is submitted herewith to cover the fees for the RCE. 
If any other fees are due in connection with this application as a whole, the Patent Office is 
authorized to deduct the fees from Deposit Account No. 02-1818. If such a withdrawal is made, 
please indicate the Attorney Docket No. (1 12857-251) on the account statement. 



Respectfully submitted. 




Christopher S. Hermanson 

Reg. No. 48,244 

P.O. Box 1135 

Chicago, Illinois 60690-1135 

Phone: (312) 807-4225 



Dated: June 3, 2005 
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